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We report a physical background of the wave function prediction in the infinite system density 
matrix renormalization group (DMRG) method, from the view point of two-dimensional vertex 
model, a typical lattice model in statistical mechanics. Singular value decomposition applied 
to rectangular corner transfer matrices naturally draws matrix product representation for the 
maximal eigenvector of the row-to-row transfer matrix. The wave function prediction can be 
expressed as the insertion of an approximate half-column transfer matrix. This insertion process 
is in accordance with the scheme proposed by McCulloch recently. 
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1. Introduction 

The density matrix renormalization group (DMRG) 
method is one of the efficient numerical method, which 
has been applied extensively to one-dimensional (ID) 
quantum systems and two-dimensional (2D) classical sys- 
tems. 1-4 ' The method is variational in the sense that it 
assumes a trial state, the matrix product state (MPS), 
which is written as a product of local tensors. 5 ~ 15 ' Or- 
thogonality of each matrix ensures the numerical stabil- 
ity. 

One of the bottleneck in the computation of the 
DMRG method is the diagonalization of super block 
Hamiltonian. The construction of a good initial vec- 
tor for this diagonalization is very important. For the 
finite-system DMRG method, the so-called wave func- 
tion renormalization scheme provides the answer. 16 ' 17 ) 
For the infinite-system DMRG method, Baxter's method 
of corner transfer matrix (CTM), 18 " 20 ' which can 
be reinterpreted from the view point of the DMRG 
method, 21, 22 ' essentially solves the problem of initial vec- 
tor. Based on Baxter's CTM method, the product wave 
function renormalization group (PWFRG) method was 
proposed, 23 ~ 25 ) and has been applied to the study of ID 
spin chains. 26 ~ 40 ) 

Recently McCulloch proposed a way of precise 
wave function prediction, which works better than the 
PWFRG method especially when the system size is small 
compared with the correlation length. 41 ' In this paper we 
present a physical background for McCulloch's scheme 
from the view point of 2D vertex model, one of the typi- 
cal lattice model in statistical mechanics. 20 ' Although we 
employ classical lattice model, most of the obtained re- 
sults can be applicable for ID quantum systems through 
the quantum-classical correspondence. 

Structure of the paper is as follows. In the next section 
we explain the symmetric vertex model, and express the 
maximal eigenstate of the row-to-row transfer matrix by 
use of CTMs. In §3 we consider the area extension of 
CTMs, introducing an approximate half-column trans- 
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Fig. 1. A finite size vertex model of width N = 8. Cross marks 
show boundary spins and open circles show row spins, which are 
the variables of in Eq. (2.1). The system consists of its left- 
half and the right half, where the vertical stitch corresponds to 



the half-column spin <j 1 , <j 2 , o" 3 



between them. 



fer matrix. We show the connection between MPS and 
CTM formulation in §4, where the system size extension 
scheme by McCulloch is obtained naturally. We summa- 
rize the obtained result in the last section, and discuss the 
remaining problem on the MPS obtained by the finite- 
system DMRG method. 

2. Eigenstate of row-to-row Transfer Matrix Ap- 
proximated by Corner Transfer Matrices 

Throughout this article we consider a square-lattice 
symmetric vertex model, 20 ' as an example of 2D classical 
lattice models. There is a d-state spin variable on each 
bond, which connects neighboring lattice points. Four 
spins around a lattice point determine the local Boltz- 
mann weight W, which is called as the vertex weight. We 
assume that the vertex weight is position independent, 
and therefore the system is uniform. We also assume that 
each vertex weight is invariant under exchange of left and 
right spin variables, and those of up and down spin vari- 
ables. In other words, we consider the symmetric vertex 
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model in order to simplify the following formulation. 

As shown on the left side of Fig. 1, we treat a finite 
size system that has a rectangular shape. This system 
corresponds to the stack of row-to-row transfer matrices 
T N , whose width is N, multiplied by an initial vector V N . 
We choose V N so that it corresponds to the boundary 
condition at the bottom of the system, where there is a 
row of boundary spins shown by the cross marks. Those 
cross marks aligned vertically also represent boundary 
spins, that are located at the both ends of T N . The row 
of open circles represents spins on top of the rectangular 
system. We consider a d^-dimensional vector 

* N = T N T N T N ...T N V N , (2.1) 

where the number of the row-to-row transfer matrix T N 
is sufficiently large. Under this assumption we can ex- 
pect that ^f N is a good approximation of the maximal 
eigenvector of T N if V N is not orthogonal to that. 

For a while let us consider the case N — 8; gen- 
eralization to arbitrary N is straightforward. We label 
the top spins as q ll q 2 , q 3l q 4 , p 4 , p 3 , p 2 , and p l from 
left to right. The vector elements of \P 8 are then writ- 
ten as * 8 (q 1 , q 2 , q 3 , q 4 , p 4 , p 3 , p 2 , p 4 ). Since we have as- 
sumed the left-right symmetry for the vertex weight, it 
is convenient to divide the row-spin into the left half 
q 1 , q 2 , q 3 , q 4 , where we have counted them from left to 
right, and the right half p 4 , p 2 , p 3 , p 4 , where we have 
counted them from right to left. (See right bottom of 
Fig. 1.) According to this division, we can interpret <i? 8 
as a d 4 -dimensional real symmetric matrix, whose ele- 
ments can be expressed as 1i % ftibi Vi P3 Pi) ■ We 
have used the vertical bar "|" to separate the left and the 
right indices, and dropped the commas between the spin 
variables for the book keeping. If necessary, we further 
abbreviate the matrix notation as *S? s (q\p). 

We express the left half of the rectangular system 
by use of the CTM, whose elements are written as 
C 4 (q 1 q 2 q 3 q 4 \o 1 a 2 a 3 . . .), where <J 1 a 2 a 3 ... represent 
the half-column spins at the center of the system. In the 
same manner we can express the right half by the trans- 
pose of C 4 , i.e., C 4 T . Joining process of these halves by 
stitching C 4 and C 4 T via the contraction of the half- 
column spins can be expressed simply by the product of 
matrices "fg = C 4 C 4 '. More precisely, there is a relation 

* 8 (q\p) = J2C 4 (q\a)C 4 (p\a), (2.2) 

where we have used the abbreviations q = qxq 2 q 3 q 4 , p = 
PiP 2 p 3 p 4 , and a = a 1 a 2 a 3 . . . . Since we have assumed 
that the number of T 8 in Eq. (2.1) is sufficiently large, 
the same for the number of column-spin a. Although we 
treat a, we do not think of them as spins directly treated 
in numerical calculations, unlike q and p. 

One of the fundamental mathematical tool in the 
DMRG method is the singular value decomposition 
(SVD). 1 ' 2 ) Let us apply it to the CTM 

c 4 (q\p) = J2Mq\0n 4 (0u 4 (<r\0, (2.3) 

where £ is a d -state block-spin (or an auxiliary) variable, 
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Fig. 2. The singular value decomposition applied to C 4 . The 
black square and circle corresponds to the block spin § and the 
singular values f2 4 (£), respectively. The left and the right trian- 
gles represent A 4 and U 4 , respectively. 



and 4 (£) represents the singular values. The matrix A 4 
is d 4 -dimensional, and it satisfies the orthogonal relations 

J2Mq'\0Mq\0 = <%'k), 
5>4(«IO4i(?l0 = ^'10. (2-4) 

where <5(£'|£) is Kronecker's delta, and where S(q'\q) is 
defined as 

5(q'\q) = f[5(q! i \q i ). (2.5) 

The above orthogonal relation can be written shortly as 
A 4 A 4 = A 4 A 4 = I 4 . Column vectors of the rectangular 
matrix U 4 are also orthogonal with each other, 

52U A (v\?)U 4 (a\Q = mQ, (2-6) 

(7 

but the row vectors are not 

J2U 4 (a'\$U 4 (a\$^5(a'\a). (2.7) 

i 

This is because the degree of freedom of a is far larger 
than that of q or £. Figure 2 is the pictorial representation 
of SVD applied to C 4 . 

We often regard the singular values f2 4 as the diago- 
nal matrix fi 4 (£'|0 = ft 4 (0<K£'IO> and write E q- ( 2 -3) 
shortly as C 4 — A 4 il 4 U 4 T . For the latter convenience, 
let us introduce the generalized inverse of the CTM 

C7 1 = U 4 Sl^A? , (2.8) 

which satisfies the relation 

C4CZ 1 = A 4 n 4 u 4 T u 4 n 4 1 A 4 T 

= A 4 A 4 T = I 4 . (2.9) 

It should be noted that C 4 1 C 4 is a projection operator 

U 4 n 4 1 A 4 T A 4 Cl 4 U 4 T = U 4 U 4 T (2.10) 

in the left hand side of Eq. (2.7), where (C 4 T 1 C 4 ) 2 = 
C 4 1 C 4 holds. 

In the context of the DMRG method, small singular 
values are neglected when it is impossible to store matrix 
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Fig. 3. The pictorial representation of P 4 = Cg 1 -C 4 in Eq. (3.1). 
The circle with the cross mark shows HJ 1 . Since P 4 has a func- 
tion of extending the area of CTM, it can be regarded as an 
approximation for the half-column transfer matrix. 



Fig. 4. The area of CTM can be extended by applying the ap- 
proximate half-column transfer matrices. 



elements during the numerical calculation. This trunca- 
tion is a kind of decimation in the renormalization group 
(RG) theory. Under the truncation, the matrices A 4 work 
as the RG transformation that controls numerical pre- 
cision. In the next section we do not truncate singular 
values, in order to avoid complications in notations, and 
the introduction of truncation is straightforward. 

3. Half Column Transfer Matrix and Matrix 
Product State 

We introduce a new notation between matrices, the dot 
product, which contract variables according to Einstein 
rule. As an example, let us consider 



P 4 — C 3 1 • C 4 , 



(3.1) 



where q 1 , q 2 , and q 3 are contracted but q 4 is not, since 
the first three spins are shared by C 3 X and C 4 . Figure 
3 shows this rule graphically. Substituting Eq. (2.3) and 
(2.8) to C^ 1 - C 4 , we obtain 

P 4 = {U 3 Sl 3 l A 3 T )-{A 4 n 4 U 4 T ) 

= C/gOg 1 - A 4 Q 4 U 4 T . (3.2) 
To avoid any confusion, let us write down element of P 4 
P 4 (a'\q 4 \a) (3.3) 



where the new matrix A 4 
orthogonal matrix 

Ai(£?4lC) = 



A 3 T ■ A 4 is the renormalized 



E 

<?1 <?2 ?3 



(3.4) 



which satisfies the relation 



Y,A i {Z< U \?)A&q 4 \Q=6{?\Q- (3-5) 



In Eq. (3.4) the group of spins q 1 , q 2 , and q 3 are mapped 
onto the block spin £ by the RG transformation A 3 . The 
obtained A 4 corresponds to the matrix that constructs 
MPS, which is constructed by the infinite system DMRG 




Fig. 5. Pictorial representation of Eq. (3.1 



method, as shown later. 

The P 4 thus obtained has a function of half-column 
transfer matrix (HCTM), since it extends the width of 
C 3 by one by way of the dot product 

c 3 ■ p 4 = c 3 ■ (cV • c 4 ) = (c 3 eV) • c 4 = c 4 (3.6) 

as shown in the left side of Fig. 4. Applying SVD to C 3 
and substituting Eq. (3.2), C 3 ■ P 4 is calculated as 

(A 3 n 3 u 3 T ) ■ (u 3 n, 1 ■ A 4 n 4 u 4 T ) =a 3 -a 4 n 4 u 4 T . 

(3.7) 

Since C 3 is again constructed from C 2 and P 3 , as shown 
in the right side of Fig. 4, we can further decompose C 4 
as 



C A 



Cn • Pn 4 Pa ~ An • Ar> * A. a £Ia U a 



(3.8) 



The contraction process by the dot products are shown 
in the right side of Fig. 5. It should be noted that C 2 • P 4 
is not C 3 , since U 2 T contained in C 2 and U 3 contained in 
P 4 do not matches to give an identity. In this sense, P 4 
is an approximation for the half column transfer matrix, 
optimized for the area extension of C 3 only. 

Using the decomposition of C 4 in Eq. (3.8), we obtain 
the matrix product representation of ^ 8 = C 4 C 4 ' . We 
have 

* 8 = A 2 -A 3 -A 4 (n 4 ) 2 A 4 T -A 3 T -A 2 T 

= A r A 3 -A 4 K 4 A 4 T -A 3 T -A 2 T , (3.9) 

where A 4 = (f2 4 ) 2 is the singular value of ^g. (See Fig. 6.) 
Such a construction of ^ 8 is equivalent to the MPS 
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Fig. 6. Matrix product expression of \J> 8 in Eq. (3.9). Double cir- 
cle represent A 4 = (Sl 4 ) 2 . 



Fig. 8. Reorthogonalization process in Eq. (4.3). The rectangular 
in the lower diagram corresponds to A in Eq. (4.4). 



Y ? I ? 




- A -A -A A /4 T -A _1 -^i A A T -A T -A T 

— S±2 ^3 IY 4 ^4 J1 3 /1 4 J1 4 /1 4 ^3 ^2 : 

which may approximate *S? 10 . Applying Schmidt orthog- 
onalization for A 4 ^4 4 T from the left side 



A 4 A/ 



BA 



(4.4) 



App. 



we obtain the new orthogonal matrix B and the right 
triangular matrix A. (See Fig. 8.) Substituting Eq. (4.4) 
into Eq. (4.3), we get the matrix product expression 

=A r A 3 .A 4 .BAA^A T B T .A i T .A 3 T .A 2 T . (4.5) 

The extension from *S? 8 to Vl/fj^' is the same as the wave 
function extension scheme proposed by McCulloch, 41 ) 
where the approximation for the renormalized wave func- 
tion is given by 



App. 
10 



Fig. 7. Approximate area extension process C 5 



considered in the context of the infinite system DMRG 
method. 

4. Approximate Area Extension 

Let us consider a problem of obtaining an approxima- 
tion of C 5 = C 4 • P 5 without using P 5 . This attempt is 
equivalent to construct an approximation for C 5 using 
C 2 , C 3 , or C 4 . One might think that P 4 = C^ 1 ■ C 4 = 

be of use as an approximation for consider the extension from 



B A A 3 _1 A T B T . 



(4.6) 



We have thus obtained a natural explanations for Mc- 
Culloch's extension scheme from the view point of 2D 
vertex model. Up to now we have not considered the ef- 
fect of basis truncation, which is used in numerical calcu- 
lation of the infinite system DMRG method. First of all, 
the extension in Eqs. (4.4) and (4.5) is still efficient under 
the truncation, as it was shown numerically. 41 ) We then 

in the large 



^ N to 



P 5 . But this idea should be rejected since U 4 T U 3 , which 
appears in the calculation of C 4 • P 4 , is not an identity. A 
way to avoid this mismatching is to introduce a spatial 
reflection of P 4 , which is defined as 



N+2 



Pa 



u 4 n 4 Af-n^uJ 



(4.1) 



system size limit N — > 00. For simplicity, let us assume 
that the MPS in this limit is uniform, and the system is 
away from criticality. In this limit we can drop the site 
index from Eq. (4.1), and can express the approximate 
transfer matrix as 



and use it as an approximation for P 5 . Leaving the va- 
lidity of the approximation scheme by the latter discus- 
sion, let us calculate the approximate extension C 5 pp ' — 
C 4 • P 4 and write it into the matrix product representa- 
tion. (See Fig. 7.) We obtain 



p = un~ 1 - Anu T = u-su T , 



(4.7) 



where S = £1 1 - A Q. From the assumed symmetry of the 
vertex model, both P and S are symmetric 



QApp. _ 



A2'A~ 3 'A 4 Q 4 U 4 U 4 £l 4 A 4 • fl^ U% 
= A, 



P(a'\q\a) = P(a\q\a') 
S(a'\q\a) = S(a\ q \o>) . 



(4.8) 



""4 "4 ^4 "3 

■A 3 .A 4 (n i fA 4 T .n 3 iu 3 T 



^2 ' ^3 ' ^4 ' ^3 1 U 3 T ■ 



and from this approximation we can construct 

_ (jApp. ^App.^T 



K PP 



(4.2) 



(4.3) 



This symmetry is also expressed in short form as P = P 
and S = S. Thus at least when the system size N = 2i 
is large enough, typically several times larger than the 
correlation length, one can justify the usage of C i ■ P i as 
the approximation for C i ■ P i+1 - 

Before closing this section, we consider the MPS ex- 
pression for that is optimized by way of the sweeping 
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Fig. 9. Graphical representation of Eq. (4-14). 

process in the finite system DMRG method. The matrix 
product structure 



A, 



(4.9) 



is similar to that obtained by the infinite system DMRG 
method, but in this case the matrices satisfies the addi- 
tional relation 



A A, 



A A T 



(4.10) 



where both A i and A i differ from those obtained by the 
infinite system DMRG method. Taking the square root 
of A i , we formally obtain a diagonal matrix fl i = y/A~. 
It should be noted that this Q i is different from that 
obtained from the SVD applied to C i . Defining 



(4.11) 



and substituting it to Eq. (4.9), we obtain a new standard 
form for MPS 



'$3 '$2 ^li 



(4.12) 



where is just a constant and is not essential. It is 
then straightforward to obtain the approximation \&jv+2 

- - T 

just by putting S» Sn at the center of the above MPS, 
where this insertion is a variant of Eq. (4.5). In the ther- 
modynamic limit N —> oo the matrix S i in Eq. (4.11) 
is independent on the site index i, and therefore it coin- 
cides with S in Eq. (4.8). This symmetric representation 
of uniform MPS is often of use. 

5. Conclusions and Discussions 

We have considered the wave function prediction in 
the infinite system DMRG method, when it is applied 
to the 2D vertex model. Through the singular value de- 
composition of CTM C i , we obtained the approximate 
half-column transfer matrix P i . The insertion of P i nat- 
urally explains the wave function prediction proposed by 
McCulloch, 41 ) which works better than the product wave 
function renormalization group (PWFRG) method, 23 ~ 25 ) 
especially when the system size is small. The differ- 
ence between these two prediction methods can be ex- 
plained by the shape of finite size system. The PWFRG 
method treats growing triangular cluster, 24 ) whereas Mc- 
Culloch's scheme always treat half-infinite stripe. 

The relation between CTM and MPS in the finite- 
system DMRG method is not so clear. For example, "Jg 
can be expressed as C 3 C 5 T , but the MPS representation 
of the optimized ^ g by the finite system DMRG cannot 



be obtained from the SVD applied to C 3 and C 5 indepen- 
dently. This puzzle is something to do with the targeting 
scheme for asymmetric vertex model, and also with the 
determination of optimal RG transformation in the real- 
time DMRG method, where the density matrix is time 
dependent. 
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